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This invention relates generally to interpolation 
of video signals and, in particular, to interpolation of 
video signals using motion estimation. 
Background of the. Invent ion 

^ In various schemes for interframe coding of 

television pictures, it is advantageous to drop or discard 
information from some fields or frames by subsampling the 
video signal at a fraction of the normal rate. This is 
done in order to prevent overflow of the data orate 
equalization buffers disposed in the transmission path, or 
simply to increase the efficiency of the encoder by 
removing redundant information. At the receiver, a 
reconstructed version of the information contained in the 
nont r ansm i t t e d fields or frames is obtained by 
interpolation, using information derived from the 
transmitted fields. Simple linear interpolation may be 
performed by averaging the intensity information defining 
picture elements (pels) in the preceding and succeeding 
transmitted fields at fixed locations which are most 
closely related to the location of the picture element that 
is presently being processed. In certain instances, the 
interpolation may be performed adaptively, such that the 
pels used to form certain reconstructed or estimated 
intensity values are selected from two or more groups 
having different spatial patterns or such that the 
information obtained from pels in the same relative spatial 
positions in the prior and succeeding frames are combined 
in two or more different ways. 
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Both the aforementioned fixed and adaptive 
interpolative techniques are adequate to estimate and thus 
recover the nontransmitted picture information v/hen little 
motion occurs in the picture* However, where objects, 
5 particularly those with a high degree of detail, are moving 
quickly in the field of view of the television camera, 
dropping fields or frames in the encoder and subsequent 
reconstruction using interpolation often causes blurring 
and other objectionable visual distortion. Accordingly, 
10 the broad object of the present invention is to enable 
improved estimation of intensity information defining 
elements in a picture using interpolative techniques on 
information derived from preceding and succeeding versions 
of the picture. A specific object is to improve the 
15 reconstruction of a nontransmitted field of a video signal 

using information from previous and succeeding fields, so 
^/ as to eliminate annoying distortion and flicker. 
Summa ry^ p f [ m t he Inv e n t i on 

The foregoing and additional objects are achieved 
20 in accordance with the instant invention by estimating the 
intensity information defining elements in a picture (which 
may be a nontransmitted field or other portion of a video 
signal) based on information defining pels in related 
locations in preceding and succeeding versions of the same 
25 picture, using an interpolative technique v/hich takes 

account of the motion of objects in the picture to identify 
the related locations. More specifically, apparatus for 
estimating the desired intensity information includes a 
recursive motion estimator for providing an indication of 
30 the displacement of objects between the two available 
versions of the picture which precede and follow the 
picture being processed and an interpolator arranged to 
utilize information defining pels at t ti"e^a ppropriate 
displaced locations within the preceding and succeeding 
35 versions to form an estimate of the desired information. 

In a preferred embodiment, an adaptive technique is used to 
switch between displacement compensated interpolation and 
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fixed position interpolation, depending upon which produces 
ft/ the best results in the local picture area. 
Br i ef Descr ipt ion i o | 1T ,-the^p,rawin^ 
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The features and advantages of the present 
invention will be more readily understood from the 
following detailed description when read in light of the 
accompanying drawing in which: 

FIG. 1 is a representation of a series of video 
fields indicating the locations of picture elements used to 
10 form estimates of nontransmitted information in accordance 
with prior art fixed position interpolative techniques; 

FIG. 2 is a similar representation of a series of 
video fields indicating the displaced pel locations in the 
preceding and succeeding frames used to estimate the 
15 information defining the presently processed picture 
element in accordance with the present invention; 

FIG. 3 is a block diagram of apparatus arranged 
in accordance with the present invention for reconstructing 
information defining pels in a nontransmitted field of a 
20 video signal by processing information derived from 

preceding and succeeding versions of the picture using 
raotio^ compensated interpolation; and 

f FIG. 4 illustrates spatial interpolation 

performed in interpolators 305 and 306 of FIG. 3. 
Detail e d D e s cri pt ion 

One embodiment of the present invention, which 
permits reconstruction of a nontransmitted field of a video 
signal using information derived from transmitted preceding 
and succeeding fields, will be better appreciated by 
30 consideration of FIG. 1, which illustrates the time— space 
relationship of a sequence of television fields 101-105, 
<^Cn each of which can be thought of as a ''snap— shot*' or version 
of a moving picture which is electrically represented by 
the video signal being processed. Vector 106 indicates the 
35 direction of time progression, such that field 101 occurs 
first and is followed in succession by fields 102. ..105. 
The time interval between successive fields is given by t, 
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and is generally 1/60 Q f a second for conventional video 
encoding, Each field is obtained by scanning the picture 
being processed along a plurality of generally parallel 
scan lines, such as lines 110—115 in field 104. In order 
5 to conserve bandwidth, a conventional video signal 

generator is arranged to interlace the scan lines in each 
pair of successive fields. Thus, each line in an odd 
numbered field is offset from the corresponding line in the 
previous (and next) field by half the distance between 
10 adjacent lines. The NTSC standard requires a total of 
525 scan lines for each pair of fields, which together 
constitute a frame. 

Assuming that even numbered fields 102 and 104 
shown in FIG. 1 were encoded for transmission using 
15 conventional subsampling and/or other compression 

techniques, and that these fields have been reconstructed 
at the receiver, it is known to reconstruct information 
defining pels in the no n t r an sm i t t e d odd fields 101, 103 and 
I^J^ 105 by interpolation. As used herein, ''information'' can 

20 include intensity information describing the different 
color components (red, green and blue) of a composite 
signal or combinations thereof, such as luminance and 
^ ^ chrominance information. Using ''intensity'' generally in 

the foregoing sense, to reconstruct or estimate the 
25 intensity value I £ for a pel E on line 120 in field 103, it 
is typical to use intensity information from spatially 
corresponding locations in the transmitted preceding 
field 102 and the succeeding field 104. Since the scan 
lines in the even and odd fields are offset from one 
30 another, the intensity values in fields 102 and 104 at the 
precisely corresponding spatial location of pel E are not 
available. However, intensity values for pels on the scan 
lines just above and just below line 120 may be used. 
Thus, the intensity of pel E can be estimated as the 

average (I A + I B + J c + Ip)/^ of the intensities of pels A 
and B in field 104 and pels C and D in field 102. As 
stated previously, this fixed position interpolation' 
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procedure for reconstructing the no nt r a n sm i t t e d fields is 
generally satisfactory, as long as objects in the picture 
are relatively still. However, in areas of the picture 
which are changing quickly, the reconstructed version 
5 generally appears noticeably blurred and distorted. This 
significantly reduces the utility of the s ub s amp 1 i ng , and 
limits the number of fields which may be dropped at the 
transmitter and successfully recovered at the receiver. 

The motion compensated interpolation strategy of 

10 the present invention, again considered in the context of 
reconstruction of a no n t r a n sm i t t e d field using information 
from preceding and succeeding fields which are available at 
the receiver, can be explained by reference to FIG. 2, 
which again depicts the time-space relationship of a series 

15 of fields 201. ..205. For the sake of generality, it is 
assumed that field intervals x including field 202 

intervene between the previous transmitted field 201 and 
the present (nontransmitted) field 203, and that field 
intervals including field 204 intervene between field 203 

20 and the succeeding transmitted field 205. K - and K ~ are, 

1 2 

of course, positive integers. In order to obtain an 
estimate of the intensity value of each pel in 
nontransmitted field 203, it is first necessary to form an 
estimate D of the displacement jjej: field inlerva^ of moving 
25 objects in the picture between the transmitted fields 201 
and 205 which bracket field 203. The underscore used for 
the variable D and here inbe low indicates a vector having 
components in the horizontal (picture element to element) 
and vertical (scan line to line) directions. It is assumed 
30 here that objects in the pictures being processed are in 

simple uniform translation during this period. Second, the 
intensity values at the displaced locations in the previous 
^ "7^ ***bf^ and succeeding transmitted fields which ' 'correspond' ' to the 

location in the field being processed are determined. As 



>^ 35 used here, the * 'correspondence' ' indicates locations at 

which the same object is expected to be in different 
versions of the picture. Finally, the desired intensity 
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value is derived using interpolation or averaging. 

To illustrate, if the position of a presently 
processed pel 250 in field 203 is denoted by vector x, then 
the location of the ''corresponding'' displaced pel 260 in 
field 201 is given by x-E^D and the intensity at that 
location is v/ritten I ( x-K , t-K ) ♦ Similarly, the 
location in field 205 of pel 270 which contains the object 
depicted in pel 250 is given by x+K^D, and the intensity at 
this location is I ( x^+K^D , t + K^T ) . In this example, the 
desired intensity value I(x,t) for pel 250 is determined by 
interpolation, such that: 
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KJ II Lilt? U L 11 C L Ji <* II U , X L JA. ^ ✓ 1' AlJ *-> 

intensity value I ( x-K , t-K ^ t ) fro 
alternate field subsampling is used, K ' = K~ = 1 and the 

1 2 V 

interpolated intensity value I(x,t) is a simple average of 
I ( x+D , t + t ) and I(x-D,t-r). 

With respect to formation of the displacement 
estimate D, it must be understood that the magnitude and 
direction of this vector varies, in a real television 
scene, as a function of both time and space. Accordingly, 
the intensity values at pels 250, 260 and 270 are not 
likely to be exactly equal. For convenience, a displaced 
frame difference DFD(x_,D) which is a function both of 
location x and displacement estimate D, is defined such 



that: 



1 




ft 



/ % DFD ( x , D ) = I (x + K 2 D , t + K 2 r) - I (x-K^D , t-K^r )*Vk>(2) ? ^ 

To estimate the value of D, it is advantageous to minimize 
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20 



25 



|DFD(^,D)| recursively for every pel position x within 
moving area of the picture. This is analogous to 
minimizing mean square error (since DFD is an error 
indicator) and can be done using a steepest descent 
technique. Thus: 



the 




D 



i + 1 



— D — 



8 V n [DFD(x,D) ] 2 



(3) 



D = D 



= D 1 — eDFD(s,D X )V D [DFDx,Dj 



(4) 



D = D 



* * 

= D 1 - eDFD ( x , D 1 ) 




K 



2 • ED(x+K 2 D X , t+K 2 r) 



+ K • ED(x-K 1 D , t-S^-c) 



K 2 • LD(x + K 2 D x , t + K 2 r) 
+K X * LD(x-K 1 D 1 , t-K 1 r) 



(5) 



In Equations (3)-(5), D 1 is a present estimate of the 



50 



i + 1 



displacement vector D and D is the next estimate, with 

the recursion being performed for each picture element 
i = 1, 2,... . The symbol indicates a gradient or 



spatial rate of change calculated assuming a displacement 
vector D. In the horizontal picture direction, the rate of 
change can be determined from ' 'element differences' ' 
ED(x,t), i.e., the intensity differences between successive 
picture elements on a single scan line evaluated at the 
location x in the field occurring at time t. The rate of 
change in the vertical direction is similarly determined 
f r o^ r 'line differences' ' LD ( x , t ) which are intensity 
differences between pels in the same horizontal position on 
difference scan lines, again evaluated at the location ^x in 
the field occuring at time t. Scaling factor e is used in 
Equa t i on s 
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The displacement recursion specified in 
Equations ^ 3)^(5) is carried out only in the moving areas 
of the pict ^ure] ~Th ese areas can be identified when the 
frame difference, denoted FD(x), has a magnitude which 
exceeds a preselected threshold value. The frame 
difference is defined as the intensity difference, at pel 
location x » as measured in the previous and succeeding 
frames. Thus: r ^ 




b FD(x) = I(x,t+K 2 r) - I(x,t-K 1 r) 



f)f\\ (6) P 



10 




15 



While it is possible to implement the 
interpolation specified in Eq. (1) and the displacement 
estimation specified in Eq . (^) , several simplifications 
can significantly reduce circuit complexity. For example, 
the displacement estimates calculated in Equations (3) - A 5 ) 
require several multiplications for each iteration. This 
can be reduced by considering only the sign of the two 
right — hand t erm s , i.e., 



4> 




D 1 + 1 = D 1 - e S IGN( DFD (x , D 1 ) )• SIGN 



V D [DFD(x,D) ] 



D = D 



(7) 



where the SIGN function is defined by 



20 



SIGN(Z) = 




0, 

Z 

W\ ' 



if [• Z I < T 
otherwise 



(8) 




25 



where T is a small non- negative number. A second 
simplification results by use of spatial gradients in only 
one transmitted field rather than in both the previous and 
succeeding fields. This modification simplifies Eq . (5) as 



foil ow s : 





Q 0°{%~ + 1 = D 1 - eDFD ( x , D 1 ) 



K 2 (el. diff. at x + K^D 1 ) 



+ 

E 2 (line diff. at x + I^D 1 ) 



(9) 
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Yet another modification is quite desirable in 

order to simplify the hardware implementation described 

below. In this modification, the present displacement 

estimate D is used to compute the intensity value I(x_,t) 

in Equation (-1), instead of the next displacement estimate 
i + 1 ^ 

D which more precisely belongs in the intensity value 

equation. This modification permits the same set of 

/intensity values to be used for both the computation of th 

displacement estimate and the interpolation of the missing 

field intensity values. 

While it is not essential in practicing the 

present invention, an adaptive technique is preferred in 

the i n t e r po 1 a t i v e recovery of no n t r a n sm i 1 1 e d fields, such 

that ' 'displacement compensated interpolation'' in accordance 

with the present invention is used instead of conventional 

''fixed position'' interpolation only when it produces better 

results. S w itching between the two types of interpolation 

is accomplished under the control of adaption logic which 

compares the magnitude of the frame difference FD (x) and 

the displaced frame difference DFD(x,D) to determine which 

is smaller. If DFD (x ,D) < FD(js), displacement compensation 

is better, and Equation (1) is used in the interpolation. 

If the frame difference is smaller, the interpolated 

intensity l(x,t) value is computed conventionally using the 

same location in the previous and succeeding transmitted 

^ £?> 

fields, as follows: f 



I ( x , t ) = 



K 



[K 1 I(x, t + K 2 tr) +K 2 I (x , t-K ± x) ] . (10) 

1 2 




35 



A block diagram of apparatus arranged to estimate 
the intensity values of elements in a picture (such as a 
nont r ansm i t t e d field of a video signal) using either motion 
compensated interpolation or fixed positon interpolation is 
shown in FIG. 3. Intensity information representing the 
versions of the picture which precede and follow the 
picture being estimated, obtained, for example, by decoding 
transmitted information representing fields such as 
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fields 201 and 205 of FIG. 2, is entered in random access 
memories 301 and 302, respectively, via lines 370 and 371. 
The information is stored within these memories such that 
intensity values for specific addressed groups of pels can 
5 be recovered. For this purpose^ each of the memories 301 
and 302 includes address inputs 303 and 304, respectively, 

* * 

which receive the integer portions of K^D 1 and K^D 1 , which 

indicate the position in fields 201 and 205 of the same 

object which is depicted in the pel for which an intensity 

10 is being estimated. The products of the displacement 

estimate D. stored in a delay element 310 and the factors 

l 

and » respectively, are formed by multipliers 331 and 
332. The intensity values for several (usually four) 
picture elements nearest the addressed displaced locations 
15 are output from memories 301 and 302 and applied to a pair 
of interpolators 305 and 306 via lines 307 and 308, 
respectively. 

Interpolators 305 and 306 aire each arranged to" 
use the intensity values output from memories 301 and 302 

* 

and the fractional part of the displacement estimates 1 

^ and K.D 1 received on lines 365 and 366, respectively, to 

^2?\ C i 

compute the intensity values I ( _x~ K , t— K^t) and 

I ( jc + K^D * , t + K^r ) . This procedure, which is essentially 

3/ intrafield interpolation ''in space'', is used because the 

25 displacement estimates usually do not indicate a sjji£ X pel 

location, but rather a position between pels; a second 

interpolation step described below, which is interfield 

interpolation ''in time'', actually calculates the 

nont r ansm i t t e d intensity values being reconstructed. To 

30 determine the intensity at the in— between locations, the 

fractional portions of the displacement estimates are 

resolved into horizontal and vertical components. The 

intensity values for pels which bracket the specified 

location both vertically and horizontally are chosen, and 

3 5 the in-between values computed by linear interpolation. An 

example of this interpolation is given below. The 

resulting displaced interpolated intensity values are 
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The sum is then scaled by i in 



multiplier 314. From the foregoing, it is seen that more 
10 emphasis is given to the intensity value of the field 

closest in time to field 203, and less emphasis is given 
the more remote field. The output of multiplier 314 on 
line 316 which represents the motion compensated 
interpolated intensity value specified in Eq . (1), is 
15 applied to one input of switch 315, ^ 

Field memories 301 and 302 are also arranged to 
make available on lines 317 and 318, respectively, the 



D I f\k f^f^ intensi tv values I(x,t-K 1 r) and X(x,t + K 2 -c) for pels in the 

transmitted fields which are in the same spatial position 
20 as the pel presently being processed. To obtain an 

estimate of I ( , t ) by fixed position interpolation, the 
intensity values are again likewise weighted by forming the 
sum of times the intensity in field 205 and K 2 times the 



intensity in field 201, and by dividing the sum by * ^ — - 



25 



3o 3 0 ~ 



f^~~ . ine resulting vaxue re 
1 2 

estimate specified in Eq . (10) 
second input of switch 315. 



3 5 



g na 1 s on 


1 ine s 


317 


i pi i e r s 


3 41 and 


342 


1 y . Th e 


output 


of 


tipl ier 


circuit 


330 


ed by th 


e factor 


the i n t e 


n s i t y 




s a pp lie 


d t o a 




position 


of 




as to s e 


1 e c t e i 


t h e r 


ue on 1 i 


ne 3 16 


or 


ut put f r 


om 





Netravali-Robbins 18-5 





- 12 - 






15 



20 



25 



30 



3 5 

3d 



multiplier 330, depending upon the relative magnitudes of 
the frame difference FD(x) and the displaced frame 
difference, DFD(s,D) . The magnitude of FD(_x) is obtained by- 
forming the differences between I(x,t-K^x) and I(x,t+K2T) 
in a subtractor 325 and applying the subtractor output on 
line 326 to a magnitude circuit 327, which disregards sign 
information. The magnitude of DFD(x,D) is obtained by 
forming the difference between X ( x-D , t-K ^-c ) and 
I ( x+D , t+K^t ) in a subtractor circuit 322 and applying the 
difference to a magnitude circuit 324, | FD (x, ) | and 

DFD(x,D) | are compared in a subtractor circuit 321, and a 
sign bit output is used to control the position of 
switch 315. Thus, when the frame difference FD (x) is 
smaller than the displaced frame difference DFD(x,D) in the 
local area of the picture being processed, switch 315 is 
arranged to couple the output of multiplier 330, 
representing a fixed position interpolation, through the 
switch to output line 390. On the other hand, if the 
displaced frame difference is smaller, switch 315 is 
positioned to couple the output of multiplier 314 
representing motion compensated interpolation through to. 
output line 3 90. The estimated intensity value available 
on line 390 can be accumulated in a memory, not shown, and 
the entire process described above repeated for the 
remaining picture elements in the field. When the entire 
field has been reconstructed, the contents of the memory 
may be applied to a display medium in the appropriate time 
position with respect to the transmitted fields, by 
multiplexing apparatus, not shown. 

As mentioned previously, the displacement 
estimate D 1 is stored in a one pel delay element 350, and 
recursively updated for each pel. To implement the 
updating, the output of delay element 350 is applied to one 
input of an adder 351, which receives an update or 
correction term as its second input on line 352. The 

i + 1 

output of adder 351 is the next displacement estimate D , 
which is, in turn, coupled back to the input of delay 
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element 350 to yield the next estimate. Displacement 
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estimates are updated in accordance with Eq . (5) only in 
the moving area of the picture, and a ' 'zero' ' update is use 
otherwise. For this purpose, the position of switch 353 is 
controlled by the output of comparator 354, the latter 
serving to determine whether or not |FD(x) | output from 
magnitude circuit 327 exceeds a predetermined threshold 
value T. If the threshold is not exceeded, the picture 
area being processed is not moving. In this circumstance, 
switch 353 is positioned as shown in FIG. 3 so as to couple 
a 

o u t p Tift of comparator 354 indicates that the frame 
difference does exceed T, a moving area in the picture has 
been detected, switch 353 is repositioned, and the 
displacement correction term (from multiplier 360) is 
coupled through switch 353 to adder 351. The magnitude of 
the update term is calculated in accordance with Eq. (,5) by 
multiplying second outputs of interpolators 305 and 306 on 



' '0' ' update to adder 351. On the other hand, if the 
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with FIG . 4 . 

30 After each no n t r a n sm i t t e d field has been 

reconstructed by interpolation in accordance with the 
present invention, it is necessary to update multiplier 
coefficients K ^ and K ^ (when either or both exceeds one) 
before the next no n t r an sm i t t e d field is processed. For 

35 example, in FIG. 2, assuming that fields 201 and 205 are 
transmitted and fields 202, 203, and 204 are not, then 
K n = K 0 = 2 when field 203 is being processed. When 
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field 202 is processed, K = 1 and K 0 = 3. On the other 

1 > 2 > 

hand, when field 204 is processed, K n = 3 and K 0 = 1. 

1 *> > 
Updating of the coefficients and is easily cafried 

out by storing their values in random access memories and 

by reading out appropriate coefficients under control of 

clocking circuitry not shown. Information needed to 

control clocking is derived from sync signals recovered 

from the transmitted video fields. 

An example of the spatial (intrafield) 

interpolation performed by interpolators 305 and 306 is 

illustrated graphically in FIG. 4. Locations P, Q, R and S 

represent four picture elements in a transmitted field of 

the signal being processed, and Ip, I , I p and Ig represent 

the intensity values at these locations. For convenience, 

it is assumed that location Q is at the origin of an 

orthogonal coordinate system, and locations P, R and S are 

at coordinates (0,1), (1,1) and (1,0), respectively. If 

the displacement estimate D shown by vector 401 has a 

horizontal component with a fractional portion x, 0 < x < 1 

and a vertical component with a fractional portion y, 

0 < y < 1, then the intensity value at location (x,0) is 

obtained by linear interpolation such that 




I t n\ = + (x)I 

| ( x , 0 ) ^ ^ Q | (s 



(id r'3 

f<*>. ~ 



nd the intensity value at location (x,l) is given by: 



( 



1) = < . 1-x) fp + (x)jC R 



12) f % 



6 



«^ The intensity at location (x,y) is also obtained by 

interpolation, sucht hat: 

3? 



I U,y) = (y)I (x.l) + (1 -y )]C (x.0> 



( 13 ) 




= y(l-x)I p + (y)(x)I R +( 1-y) ( 1-x ) I Q 

+ (l-y)(x)I 0 . (14) 
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From Eq. {1A)» it is seen that I. * is a weighted sum of 
the intensities of the pels surrounding /the location 
specified by the displacement Estimate, with more weight 
being given to the closest pels. If desired, other 
interpolation weights can be used, or additional samples 
can be used to contribute to the weighting pattern. 

The manner in which element and line differences 
ED and LD are formed in interpolators 305 and 306 can also 
be illustrated by reference to FIG. 4. For example, if Ip, 
Iq, Ig and Ig represent the intensity values for pels in 
field 201 at time t — K^x and at spatial locations which 
surround the location indicated by vector 401, then the 
element difference ED can be represented by 

fl^l'Hl^t 2 I(I R" I P ) + (I S -I Q )1 and the line difference LD can be 

L 15 represented by 2*£(*Q~*p) + ^*S~ I R^''* This calculation 

averages the differences, in both the horizontal (element) 
and vertical (line) directions, for pels surrounding the 
location for which an intensity value is being estimated. 
Alternatively, a simple calculation can use a single 
difference (I^-Ip) for ED and (~Q~^p) f° r LD . In either 
event, interpolators 305 and 306 may include suitable 
arithmetic circuits for forming the desired differences. 

The time wise interpolation performed by 
multipliers 311, 312 and 314 can be further illustrated by 
25 several examples. If a series of fields is designated a, 
b, c, d... and if every third field a, d, h... is 

, then the intensity value I- in field b is 




transmitted fields a and d as follows: 



30 




1 



ansmi 


1 1 e 


const 


rue 


ansmi 


t te 








e i n t 


ens 







and I ^ f r ora the 



I. = \ ( 2 I + I ) 
/ b 3 ^(a ( d 



in field c is given by 



I 



\ (I + 2 I ) 

5 i a id 



. f 5 



^ As a second example, if every fourth field a, e, i. 



i n 
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the series is transmitted, the reconstructed intensity- 



value I in field b is given by 




I, = T (3 I + I ) 

I b 4 f i a i e 



Similarly, the reconstructed values for fields c and d are 





i 
i 



i 

4 



= ~ ( 2 I +21), and 
^ ?a £ /e 



= 7 (I +31) 
4 a ^ / e 




Various modifications and adaptations may be mad 
to the present invention by those skilled in the art. 
Accordingly, it is intended that the invention be limited 
only by the appended claims. For example, while the 
preceding description primarily described reconstruction o 
nontransmitted interlaced fields, it should be clearly 
understood that the present invention enables efficient 
reconstruction of information defining a picture or a 
portion of a picture using similar information derived fro 
preceding and succeeding versions of the picture which 
include the same spatial area. 
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